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SUMMAKV 

The  problem  treated  here  deals  with  the  "debugging"  of  u  new 
complex  system  during  the  Initial  j»e r tod  of  Its  total  life.  During 
thia  period  failures  and  errors  are  corrected  art  they  occur,  with  re¬ 
sult  in^  improvement  in  subsequent  performance  of  the  system.  One 
sathemat  ica  1  idealisation  of  tele  process  lends  to  the  assumption  that 
system  failure  rate  is  decreasing  with  time.  In  practice,  the  de¬ 
bugging  phase  is  considered  completed  when  the  failure  rate  reaches 
an  equilibrium  or  constant  value.  Modelb  are  totem luted  for  this 
phenomenon.  Maximum  likellh  d  estimates  are  obtained  for  relevant 
failure  rate  functions  and  f-  r  the  end  of  the  debugging  period.  A 
conservative  upper  confidence  hound  on  the  stable  failure  rate  Is 
obtained. 

The  problem  is  treated  from  a  point  of  view  which  lies  between 
a  completely  nonparanet r lc  approach  In  which  no  information  is  assumed 
available  concerning  the  form  of  the  distribution,  and  a  parametric 
outlook  in  which  the  form  of  the  distribution  is  assumed  known  but  a 
finite  number  of  parameters  need  to  be  estimated. 


awte 
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1.  INTRODUCTION 

It  is  common  practice  after  installing  a  new  complex  system  such 
as  that  Involvings  computer,  airplane,  etc.,  to  "debug"  It  during  the 
initial  portion  of  its  total  life.  During  this  debugging  period, 
failures  ami  errors  urt  corrected  as  they  occur,  with  resulting  Im¬ 
provement  In  subsequent  system  performance.  One  mathemat  lea  1  ideali¬ 
sation  of  this  process  leads  to  the  assumption  that  system  falluic 
rate  Is  decreasing  with  time.  In  practice,  the  debugging  phase  is 
considered  completed  when  the  failure  rate  reaches  an  equi 1 ibrlum  or 
constant  value.  An  im|>or(ant  problem  is  to  determine  when  the  constant 
failure  rate  condition  has  been  achieved  and  to  estimate  the  constant 
failure  rate. 

Another  problem  lelated  to  the  debugging  problem  in  many  respects 
is  the  "burn-in"  problem  considered  by  Barlow,  Madansky,  Proschan  and 
Schcuer  (1963).  The  object  of  "burn-ln"  is  to  eliminate  poor  quality 
ilcna  in  some  population.  However,  in  the  "burn-in"  problem  con¬ 
sidered  there,  items  tail  at  most  once  and  no  rrpair  occurs.  Lewis 
(1966)  developed  a  branching  Poisson  process  for  the  analysis  of  com¬ 
puter  failure  patterns.  Although  he  considers  computer  failure 
times  which  ostensibly  occur  after  the  debugging  period,  his  model 
could  be  used  for  the  debugging  period  as  well.  However,  he  makes 
more  assumptions  than  we  do  in  a  highly  structured  ma therna t lea  1  model. 

Wc  obtain  maximum  likelihood  estimators  (Ml.E'c)  for  the  failure 
rate  function  and  conservative  confidence  bounds  on  the  failure  rate  at  a 
specified  time.  This  is  done  without  the  customary  assumptions  con¬ 
cerning  the  form  of  the  life  distribution.  The  approach  is  Intermediate 
between  a  completely  nonparamel r ic  point  of  view  (in  which  no  infor¬ 
mation  is  assumed  available  concerning  the  form  of  the  distribution) 
and  a  parametric  outlook  (In  which  the  form  of  the  distribution  is 
assumed  known,  but  a  finite  number  of  parameters  arc  to  be  estimated). 

Next  we  find  methods  which  allow  us  to  claim  with  specified  (high) 
assurance  that  the  "stable"  failure  rate  of  a  system  which  is  being 
debugged  during  development  and  initial  use  is  no  greater  titan  a  certain 
value. 
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Clearly,  without  a  knowledge  of  the  form  of  the  di  si  r  1  but  Ion  of 
a  relevant  statistic,  we  cannot  hope  to  obtain  exact  confidence  bounds. 
However,  we  do  obtain  c o naje rv at  1  ve  confidence  hounds.  That  1b,  our 
assurance  In  at  leant  (Instead  of  exactly  equal  to)  a  specified  value 
that  the  reliability,  failure  rate,  etc.,  falls  In  none  confidence  net 
determined  from  the  ob«ervnt Ions.  Of  cou.bc,  t lie  price  we  pay  1 »  that 
the  confidence  Beta  tend  to  be  larger  than  In  the  cant  In  which  the 
failure  distribution  In  an a uned  to  belong  to  a  particular  family  of 
dlfltrlbut lonn.  However,  we  shall  show  that  the  conservative  confidence 
bounds  obtained  have  the  property  that  for  a  member  of  the  clann  of 
dlfltrlbut Inna  under  conniderat Ion  t lie  confidence  bounds  are  exact, 
not  merely  conservative 


2.  DKBl'CCl SC.  MODELS 

Suppose  Xj ,  the  tine  to  the  first  failure,  has  distribution  F(t) 
with  failure  rate  r(t)  which  is  nonincrcnslng  for  t  >  0.  After  each 
failure,  repair  Is  performed  In  a  negligible  length  of  tine  so  Chat 
the  system  operates  again.  Assume  further  that  the  system  failure  rate 
Is  restored  to  the  value  it  had  Just  prior  to  the  failure.  Specifically, 
assume  that  X^,  the  tine  between  the  (i-l)st  failure  and  the  1-th  fail¬ 
ure  has  distribution 


Fv  (x) 
*1 


F<Si_1  +  x)  -  F(Sj_ j) 


for  x  >  0 


(where  S^  •  Xj  +  . . .  +  X^  and  F(x)  -  l-F(x)),  the  conditional  distri¬ 
bution  of  a  system  of  age  S^_^. 

Clvcn  observations  X^,  Xj,  ....  X^,  we  wish  to  estimate  r(t)  for 
0  <  t  <  Sr.  More  generally,  we  may  have  k  copies  of 
the  system,  each  copy  independently  operating  as  before.  Observations 
Xjj,  1  ■  1,  2,  ....  k;  J  ■  1,  ...,  are  obtained.  The  distribution 
of  X^  is 


Fy  (x) 

u 


r(si.i-i  *  10  ~  r<si.i-i> 
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t  tier  conditional  d  lft  t  r  Unit  ion  of  in  item  of  age  ^i  ,)-l  "  Xil  +  X12  +,,,+  Xi  ,J-1* 

Again  wt*  wiftti  to  estimate  r(f)  during  the  ohi.crv.it  ion  period. 

If  the  failure  rate  firm  decreases  and  then  becomes  constant 

for  t  >  t  ,  we  may  wltih  to  estimate  t  and  r(t  ).  It  is  of  interest 
o  o  o 

to  note  the  common-sense  procedure  often  used  in  this  situation  to 
estimate  t  and  r(to).  A  graph  is  drawn  in  which  the  comulativc  num¬ 
ber  of  failures  is  plotted  against  elapsed  operational  time  as  in 
Fig.  1.  (See  Hot no r  (1061)).  Debugging  is  terminated  approximately 
at  that  point  in  time  when  the  slopes 

h  -  (h  -  1)  _  }_ 

sh  '  Vi  V 

of  successive  secants  (shown  hy  dashed  lines)  appear  to  have  reached 
sn  equilibrium  value.  Those  slopes  represent  failure  rates  over 
Successive  time  periods.  System  improvement  corrcs|>ond8  to  the  situ¬ 
ation  in  which  the  slopes,  ,  are  decreasing  with  h.  However,  doc 

xh 

to  statistical  fluctuations,  some  reversals  will  occur.  The  common - 
sense  graphical  procedure  described  above  furnishes  no  precise  way  of 
taking  into  account  tlusc  reversals.  Our  technique,  based  on  maximum 
likelihood,  provides  for  this. 

In  many  practical  situations  it  is  not  realistic  to  Insist  on 
determining  the  point  lQ  beyond  which  failure  rate  is  constant.  Rather, 
for  pragmatic  purposes  it  suffices  to  find  the  point  t^,  such  that 
r(tj)  -  |  im  r(t)  ■  c  for  some  specified  c  >  0.  Thus,  we  wish  to  find 
the  point  beyond  which  further  reliability  improvement  can  decrease 
the  failure  rate  by  only  c.  Wc  wish  to  obtain  maximum  likelihood  es¬ 
timates  of  tj  and  a  conservative  upper  bound  on  r(t^). 

3.  MAXIMUM  UKKUIIOOD  KSTIMATKS  FOR  IQUCGINC  HODKLS 

A 

We  begin  by  giving  the  MI.K ,  r^(t),  for  a  decreasing  failure  rate 

function  based  on  a  sample  of  size  n:  . ^rom  one  C0Py 

of  the  system.  The  derivation  of  the  MLF  is  very  similar  to  that  given 
for  a  decreasing  failure  rate  function  based  on  n  independent  observa¬ 
tions  from  a  DFR  distribution  (Marshall  and  proschan  (1965))  and  is 
therefore  omitted.  (See  also  Brunk  (1965)  for  related  estimates.) 
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Recall  the  notation  Sj  -  X{  +  Xj  +  . . .  +  Xj  with  the  convention 

that  S.  »  0.  Tito  Ml.K  r  (t)  Is  constant  on  the  intervals  (S . ,  ) 

u  i)  ^  2  l  *  *  i 

for  1  ■  0,...,  n-1.  "lie  MLR  for  r(t)  on  (S^ ,  S1  +  j)  Is  X^+j  before 

taking,  account  of  the  fact  that  the  distribution  is  DFR.  If  it  turns 

out  that  X,1  >  X,*  >  ...  >  X  *,  then  we  conclude  that  r  (t)  ■  X* 
1-2-  -  n  n  i+1 

for  S.  <  t  <  S.  . ,  1  •  0,  1,...,  n-1.  If  a  reversal  occurs,  say 

-1  1  -1  1+1 

X.,,  <  X.,.,  then  we  nust  average  to  obtain  a  ronnrn  estimate  of 

1+1  1+2  ,  j  »  j 

failure  rate,  K  (’<^+|  "*  Xj^)}  ’  ^or  <  1  -  ^i+2*  ^oxt  wc  ex” 

. . .  *1' . *;'•('>  <xltl  ♦  wl'1.  fl  <xi+1  +  w}"1- 

-i  - 1 

X. .......  X  to  see  If  these  estimates  of  the  failure  rate  on  the 

i+3  n 

successive  intervals  ire  decreasing.  If  so,  they  constitute  the  MLE's 
of  the  failure  rates  >n  the  successive  intervals.  If  not,  we  continue 
to  average  until  no  reversals  remain.  At  the  end  of  this  process,  we 
obtain  Midi's  r^  _>  >  ...  >  r^,^  satisfying: 


r.  -  I  -1  (X,  +  . . .  +  X  )1  , 

Ml  lni  1  ni  \ 

f  i  r1 

rn.+l,n0  * - (X  ..  +  ,.,  +  X  )  , 

1  *2  ln2  '  nl  nl+1  n2  I 


n^+l.n  ’  (n  -  nk*Xnk+l  +  *"  +  Xn*}  ’ 


and 


r.  for  0  <  t  <  S 

l.nj  -  “  ni 


r  ft)  »  jn.+l.n.  for  S  <  t  <  S 

rn^c;  /  1  2  nj  -  n2 


(3.1) 


r  ,,  for  S 
nk+1 ,n  nk 


<  t  <  S  . 
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No  estimate  of  r(t)  is  made  for  t  >  S  since  no  data  arc  available  for 

n 

that  time  interval. 

Example  1.  In  Fig.  1  the  cumulative  number  of  failures  versus 
times  of ‘failure  is  graphed  for  the  following  data 


Time  of 
Fai lure 

■  25  hours 

■  75  hours 

=  125  hours 

S.  ■  165  hours 
4 

■  240  hours 

S,  =  310  hours 
6 

*  4 10  hours 


Time  Betvorn 
Successive  Failures 

Xj  =  25  hours 

X^  =  50  liours 

E  50  hours 

X.  =40  hours 
4 

X,.  =  75  hours 

X  =  70  hours 
6 

X^  =  100  hours 


We  arc  assuming  that  r(t)  is  decreasing  in  t.  If  there  were  no 
reversals  in  the  observed  failure  rates  on  successive  intervals,  the 
estimate  of  r(t)  would  be 


r(t) 


<  t  5  Si> 


1, 


,  7; 


i.e. 


» 


JL.  i_.  JL.  JL.  1_.  J_.  i_ 

25’  50’  50’  40’  75’  70’  100  ’ 

However,  since  7-r  <  77:  and  ~  <  -777,  we  have  two  reversals. 

50  40  75  /0 

By  combining  the  second,  third, and  fourth  estimates  (adding 
numerators  of  the  three  estimates  to  obtain  a  new  numerator,  and 
adding  denominators  to  obtain  a  new  denominator),  we  obtain  as  our  new, 
tentative  estimate  of  r(t): 


-L.  3 3 3 _1 JL.  JL_ 

25  ’  140’  140’  140’  75’  70’  100 
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The  reversal  ■— —  <  Is  left.  Combining  these  as  before,  we 
obtain  finally  as  the  MLE  of  r  at  the  observations: 

*(25)  =  ~ 

*(75)  »  r (125)  -  *(165)  *= 

*(240)  -  *(310)  -  ~ 

Jwio)  -  . 

Between  successive  observations,  r  is,  of  course,  constant.  Using 
this  "smoothed"  data,  we  obtain  a  new  graph  in  Fig.  2,  in  which  the 
slopes  (failure  rates)  of  Fig.  1  are  smoothed. 

ULF.  for  a  Decreasing  Failure  Rate  from  k  Copies  of  the  System 

Using  the  same  techniques  as  in  the  case  of  a  single  copy  of  the 

system,  treated  above,  we  may  obtain  the  MLE  of  the  failure  rate,  assumed 

decreasing. .  Again  the  derivation  of  the  MLE  is  similar  to  that  given  in 

Marshall  and  Proschan  (1965)  and  is  omitted. 

First  the  actual  failure  times  (not  intervals  between  failures) 

for  all  k  systems  are  pooled  and  ordered.  Call  these  ordered  obser- 

k 

vations  T,  <  T_  <  . .  .  <  T  ,  where  n  »  £  n . .  Between  successive  T.  , 
l  -  2-  -  -  n  l  l 

the  failure  rate  estimate  is  constant  as  above.  Our  initial  estimate 
of  the  failure  rate  ir.  an  interval,  before  imposing  the  constraint  that  the 
failure  rate  be  decreasing,  is  computed  as  the  reciprocal  of  the  total 

test  time  observed  in  that  interval.  Thus,  on  [0,  T. ] ,  the  initial  es- 

-1  1  -1 
timate  is  (n  T^)  ,  on  (T^,  T2],  the  initial  estimate  is  (N^^-T^)}  , 

on  (T2 ,  )  *  the  initial  estimate  is  {^(T^^))  **  •••»  on  (Tp_^,  Tn^* 

the  initial  estimate  is  (T  -  T  ,)  ^  where  N.  is  the  number  of  systems 

n  n-i  1 

simultaneously  in  operation  during  (T^,  T^+^].  On  (Tn,«°),  no  estimate 
of  failure  rate  is  made  since  no  failures  are  observed. 

The  initial  estimates  are  then  compared;  if  they  are  in  decreasing 
order,  they  constitute  a  MLE  of  r(t)  on  [0,  T^].  If  a  reversal  occurs, 
we  average  as  above  to  eliminate  it.  For  example,  if  ^(T^  -  T^)  ) 
N^(T^+^  -  T^) ,  the  revised  estimate  of  the  failure  rate  on  (T^  T^+^] 

is  +  Ni^Ti+i~Ti^}  **  We  continuG  averaging  in  this 


fashion  until  all  reversals  are  eliminated.  The  resulting  estimate  is 
the  MLE  of  r(t)  on  [0,  T  ]  under  the  assumption  that  r(t)  is  a  de¬ 
creasing  function. 

Strong  Consistency  of  the  MLE 

In  this  subsection  we  show  that  the  MLE  for  the  decreasing  failure 

rate  obtained  above  from  k  copies  of  the  system  is  consistent.  We 

assume  that  at  least  t  hours  of  operation  are  observed  for  each  of  k 
systems.  We  shall  show  that  as  k  +  «,  r^(t)  *  with  probability  one. 

Let  n. (t)  be  the  number  of  failures  of  the  i-th  system  and 

n  “  n(t)  =  £  n^(t)  be  the  total  number  of  failures  over  all  k  copies 

in  [0,  t].  i=1 


Then 


Pln^t)  =  j] 


l/*r(x)  dx]^  *  r (x)  dx 


(n^(t),  t  >  0}  is  a  non-homogenous  Poisson  process  with  intensity 
function  r(t)  ,  and  En^t)  =  J*  r(x)  dx. 


Lemma  3.1.  Suppose  k  systems  operate  between  observed  failure 

m 

times  T._.  and  T  .  Then  Z .  =  k  /  i  r(u)  du,  i  =  l,2,...,n,  are 
1  1  1  Ai-1 

independently  and  identically  distributed  with  exponential  distribution 
P[Z^  <  z]  =  1-e  Z. 

For  a  proof  see  Barlow  and  Proschan  (1969) .  |  | 

inf 


Let  T.  <  t  <  T...  and  r.  (t  )  -  sup  , 

i  -  °  i+1  k  o  t>i+1  s<i  t-1 


t-s 


;s  k(vrv 


Theorem  3.2.  Let  r(x)  be  nonincreasing  in  x  >  0  and  each  of  k 
systems  be  observed  for  at  least  t  hours  of  operation.  Then 

r(t  )  >  lim  sup  r,  (t  )  >  lim  inf  r.  (t  )  >  r(t+) 

0  “  k  0  -  k-~  k  0  ° 

with  probability  one. 

Proof.  Since  the  proof  is  essentially  the  same  as  in  Marshall  an 
Proschan  (1965)  (abbreviated  MP(1965)),  we  merely  indicate  the  necessary 
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changes  in  certain  details.  To  make  the  identifications  easier,  we 
assume  that  r(x)  is  nondecrcasing  rather  than  nonincreasing  as  in  the 
hypothesis  above.  This  merely  affects  the  ordering  of  the  Inequalities 
and  the  order  in  which  we  maximize  and  minimize. 

The  X^  in  MP(1965)  become  T^  in  our  model,  "hile  the  number,  n-i, 
of  items  on  test  between  X^  and  X^+^  becomes  the  number  k  of  items  on 
test  between  T^  and  T^.  Let  aj(n)  +  1  be  the  index  of  the  largest 
T^  observation  <  t j ,  j=0,l,  as  in  MP(1965).  Then 


Z 


i 


i+1  r (u) 
r(t.) 
i 


du 


are  independent,  identically  distributed  random  variables  with  mean 
y  As  in  MP(1965),  we  wish  to  show  that  P[lim  sup  B^)  ■  0,  where 


B 

n 


I  -1  m  , 

max  I  m  E  .  -  -  1  x  |  >  . 

al(n)-ao(n)<m<ai(n)  i=l  ui  rCt^  *  -  E 


The  main  change  in  the  proof  occurs  with  respect  to  our  definition 

of  A  .  Their  set  A  becomes 
n  n 

t 

An  =  (la^n)  -  k  r(x)  dx|<  k  6,  i=0,l], 

where  6  satisfies  0  <  25  <  /t  r(x)  dx.  Since 

o 

a  (n)  n.  (t. )+...+  n,(t.)  a.s  t. 

l  li  Ki„fi/Xj 

- - - -  -  Jo  r(x)  dx 

c 

by  the  strong  law  of  large  numbers  for  i=0,l,  we  have  P[lim  sup  A^J  ■  0, 
and  the  remainder  of  the  proof  is  identical  with  that  of  MP(1965). 


(Note:  See  Fig.  1  for  unsmoothed  graph.) 
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Example  2:  The  method  for  obtaining  the  MI.K  of  r(t)  in  the  system 
debugging  model  Is  Illustrated  for  two  copier,  of  the  sam-  system. 
Suppose  System  1  fails  at  times 


Sn  -  25  hrs . ,  S12  -  125,  -  240, 


and  that  System  2  falls  at  times 


S21  "  75,  S22  "  165’  S23  "  31°*  S24  "  A10' 


If  the  failure  times  are  pooled  and  u^c  denoted  by  T^,  T2>...,  as  before, 
then  our  estimate  of  r(t),  assuming  no  reversal,  would  be 


r(t) 


207“- T— )  f°r  Ti-1  <  1  -<  V  1  -  5 


1 


-  for  T  .  <  t  <  T  , 
i  "  i-1  1-1  "  1 


i  >  5; 


1 


1 


1  1  1 


1 


i,e'*  50’  loV  1005  80 ’  l';0:  70 5  100'  Slncc  100  <  *80  and  150  <  70* 


we  have  two  reversals.  By  combining  the  second,  third,  and  fourth 
estimates  as  before,  we  obtain 


1 


1 


50’  280’  150’  70’  100' 


By  combining  the  estimates  and  yg,  which  represent  a  reversal,  we 


obtain 


1 


1 


50’  280’  220’  100’ 


2  1 

The  reversal  yy-j  <  Jqq  is  still  left.  Combining  as  before,  we 


finally  obtain 


'  ~  for  0  <  t  <  25 


r(t) 


280 


for  25  <  t  <  165 


yy-Q  for  165  <  t  <  410. 


— 


To  estimate  the  end  of  the  debugging  period,  wo  first  compute  the 

MLE  for  the  failure  rate  as  above.  Now  suppose  r(t)  la  decreasing 

for  0  $  t  5  t  and  constant  for  *  *  t  .  The  MU!  for  the  end  point  of 

o  o 

the  debugging  period  is  the  beginning  of  the  last  averaging  interval. 

Tills  is  a  consequence  of  the  invariance  property  of  the  ML’.;  i.e., 

the  MLE  of  a  function  u(r(t))  of  the  failure  rate  is  the  same  function 

u(r(t))  of  the  failure  rate  MLE.  In  the  notation  of  (3.1),  tQ  ■  S  . 

The  MLF.  for  r(t  )  is  the  value  of  r(t)  in  the  last  interval,  that 
o 

is  r(t  )  -  r  ,,  .  It  turns  out  that  in  this  case  the  MLE  of  t  is 

o  n^+l.n  o 

a  poor  one  (i.e.,  is  not  even  consistent)  since,  os  the  number  of  ob¬ 
servations  increases  to  infinity,  t  converges  almost  surely  to  infinity, 
as  may  be  shown  by  using  the  result  of  Andersen  (1954),  p.  218,  top. 

Now  suppose  Clint  we  wish  to  estimate  t^,  the  left-most  po<nt  beyond 
which  the  failure  rate  does  not  decrease  by  more  than  c.  Specifically, 
t.  ■  Inf { t :  r(t)  -  lim  r(t)  <  c}.  Denote  by  k  the  smallest  index  k 

such  that  r(Sk)  -  r(Sn)  <  c.  Then  the  Ml.K  for  tj  is  tj  -  Again  we 

are  using  the  invariance  property  of  the  MLF.  described  above. 

Since  r(t)  is  a  consistent  estimator  of  r(t),  it  follows  readily 
that  tj  is  a  consistent  estimator  of  t^,  assuming  r(t)  is  strictly  de¬ 
creasing  in  any  interval  containing  . 


4.  CONSERVATIVE  CONFIDENCE  BOUNDS 

In  this  section  methods  are  presented  which  allow’  us  to  claim  with 
•pecifled  (high)  assurance  that  the  "stable"  failure  rate  of  a  system 
which  is  being  debugged  during  development  and  initial  jso  is  no  greater 
than  a  certain  value. 

The  basic  idea  in  obtaining  the  conservative  confidence  bound  on 
r^,  the  stable  failure  rate,  may  be  stated  intuitively  ns  follows.  The 
observation,  ,  is  a  random  variable  from  a  distribution  whose  failure 

rate  at  each  point  of  time  is  at  least  as  great  as  rQ ,  i  ■  1 . n. 

Therefore,  if  one  uses  observations  X^,  X2,  ...,  X^  to  estimate  a  single 
failure  rate  (pretending  that  all  the  X^  are  from  a  common  exponential 
distribution),  the  estimate  will  tend  to  be  higher  than  ro*  Similarly, 
an  upper  confidence  bound  for  this  common  failure  rate,  calculated  from 
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the  observations  X, ,  X«,  ....  X  as  though  they  were  a  sample  from  a 
l  i  n 

■ingle  exponential  distribution,  will  constitute  a  conservative  upper 
confidence  bound  for  rQ.  We  make  these  ideas  precise  now. 

l.cmma  4.1.  Let  X^  have  distribution  F(x),  have  conditional 
distribution 

F(X1+x)  -  FCXj) 


nxx) 


X^  have  conditional  distribution 


F(Si_!+x)  -  FfS^) 

‘  I  •  •  •  t 

r<si-i> 

where  F  has  failure  rate  r(t)  >  r  for  all  t  >  0.  Let  Y,,  Y0,  . . .  ,Y 

-  o  -  1  l  n 

be  independent  observations  from  the  exponential  distribution  with 

n  ^  n 

failure  rate  rQ.  Then  j;  j  is  stochastically  smaller  than  E^  Y^. 

Proof.  First  assume  that  F  is  continuous.  Let  the  random  var¬ 
iables  Xj,  X^  +  Xj . £  "  Xi  be  simultaneously  transformed  into  ran¬ 

dom  variables  Yj,  Yj^  +  Y^,  ...»  £  "  Y|  under  the  transformation 

(4.1)  YJ  +  ...  +  YJ  -  -  log  F(XX  +  ...  +  X1),  i  -  1 . n. 

T  o 

Then  for  i  -  1,  ...,  n, 

P[Y'  >  u]  -  P(-  ~  1°8  F(XX  +  ...  +  Xt)  +  ~  log  F(XX  +  ...  +  Xi  l)  >  u] 

O  0 


F(X,+...+X  ) 

-  P  log  - - - - - 

FCXj+.-.+X^) 

F(X+. ..+X) 

-  P  - ± - —  <  e 

F(X  +...+X  x) 


<  -  r  u 
o 


-r  u 
o 


since  the  random  variable 


F(X1+...+Xi) 

F(X1+...+Xi_1) 


The  random  variable  U  is  said  to  be  stochastically  smaller  than 
the  random  variable  V  if  P(U  >  t)  <  P(V  >  t)  for  each  real  value  t. 
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is  uniformly  distributed  on  [0 , 1 ) .  *  Thus,  the  Y.' ,  ....  Y'  arc 

*  n 

independently  distributed  according  to 

-r  x 

Gr  (x)  -  1  -  c  °  , 
o 

the  exponential  distribution  wi  th  failure  rate  r  . 

1  -  p 
Next  observe  that  if  y  -  -  —  log  F(x)  ,  then 

o 


*2  b  T(x) 
dx  r 

o 


for  all  x  r?  0. 


Thus,  under  the  transformation  (4.1) 


y;  +  .. .  +  y*  *  x,  +  ...  +  x  . 

1  n  1  n 


hh  n 

It  follows  from  Lehmann  (1959),  Lemma  1,  p.  73,  that  Y^  is 
stochastically  larger  thanE^X^. 

If  F  is  not  continuous,  the  same  result  may  be  obtained  by 
limiting  arguments. || 

We  now  apply  Lemma  4.1  to  obtain  a  conservative  confidence 

bound  on  r  from  observations  Xlf  ...,  X  . 

o  In 

Since  Y. . -Y  arc  exponential  with  failure  rate  r  , 

In  o 

2  n 

*1  a(2n)/2E"Yi  is  an  upper  100(l-or)  percent  confidence  bound  on 
2 

ro>  where  x^.(y(2n)  is  the  100(l-ar)  percentile  of  the  chi-square 
distribution  with  2n  degrees  of  freedom.  Hence 


If  a  random  variable  T  has  survival  probability  function  H,  a 
continuous  function,  then  the  random  variable  ii(T)  is  uniformly  dis¬ 
tributed  on  (0,1];  P(S£_i  +  x)/F(Sp^)  is  the  conditional  survival 
probability  function  of  X,  given  S. 

**  1-1 

This  Lemma  states:  "Let  and  F,  be  two  cumulative  distri- 

o  1 

bution  functions  on  the  real  line.  Then  Fj(x)  £  F0(x)  for  all  x  if 
and  only  if  there  exist  two  nondecreasing  functions  fQ  and  fp  and 
a  random  variable  V,  such  that  (a)  fQ(v)  £  f^(v)  for  all  v;  and  (b) 
the  distributions  of  fQ ( V)  and  fj(V)  are  Fq  and  F^  respectively."  In 
our  case  take 

fc(v)  *  V,  fj(v)  -  -  log  F(v)  ,  Fo  -  F,  F1  *=  Gr  . 

0  o 
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1-a  -  P[ro  <  Xi_a(2n)/2£j  <  P[rQ  <  X (2n ) /2 e"  Xj. 

2  p 

Thus  Xj_a(2n)/2E^  Is  a  conservative  lOO(l-a)  percent  upper  confi¬ 
dence  bound  on  rQ.  Note  that  if  F  is  the  exponential  distribution, 
the  confidence  bound  is  exact. 

Examples 

(i)  In  Example  1,  n  B  7  and  EX.  ■  410.  Choosing  a  ■  .05,  we 

1  2 

find  from  chi-square  tables  that  x  ^(14)  *  23.7.  Thus,  a 
conservative  95  percent  upper  confidence  bound  on  rQ  is 
23.7/820  =  .0289.  That  is,  P[ro  <  .0289]  >  .95. 

(ii)  The  data  in  Example  2  come  from  two  copies  of  the  system. 

The  procedure  for  more  than  one  copy  of  the  system  is  essen¬ 
tially  the  same  as  that  for  one  copy  of  the  system,  viz.  a 
conservative  100(l-a)  percent  upper  confidence  bound  on  ro 

2  k  ni  k 

is  Xj_a(2n)/2E^  E^  X^^j .  where  n  -  E^  n^,  k  is  the  number  of 

copies,  and  n^  is  the  number  of  observations  on  the  i-th  copy. 

For  the  data  in  Example  2,  k  *  2,  n^  ■  3,  nj  *  4  (so  that 

n  ■  7) ,  and  EE  X^j  ■  650.  Choosing  a  ■  .05,  a  conservative 

95  percent  upper  confidence  bound  on  r  is  23.7/1300  ■  .018. 

o 

That  is,  P[ro  <  .018]  >  .95. 


I 
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